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ABSTRACT 

The basic premise explored in this paper is that the 
conception of educational research which has dominated thinking in 
the past and continues to influence how the research community thinks 
and what it does today is inadequate and to some extent, 
inappropriate. This paper is divided into four sections. Section 1 
explicates the traditional conception of research in education and 
discusses the role research was traditionally expected to play in 
education. Section 2 focuses cn more contemporary views about the 
form and function of research in education. Evidence of both growing 
skepticism about traditional views and continued acceptance of 
traditional notions is presented. The third section focuses on 
problems with the traditional views of research and the traditional 
view of research's role in applied public policy fields such as 
education. The final part of the paper focusos on implications of the 
two problems discussed in Section 3 for rethinking the form and 
function of educational a research in general and for constructing a 
research agenda for the National Center for Science Teaching and 
Learning. (PR) 
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In this review and critique of traditional research in science education, Professor 
Robert Donmoyer of The Ohio State University argues that the tradtional mode of 
research is inadequate and inappropriate, andthattheproblemsof"idio$yncracyand 
immaculate perception "will require dramatic change within the research community 
if research is to have a positive impact on science education practice . 



The basic premise to be explored here can be 
stated succinctly: the conception of educational 
research which has dominated our thinking in the 
past and continues to influence how we think and 
what we do today is inadequate and, to some ex- 
tent, inappropriate. The paper is divided into four 
sections. Section 1 explicates the traditional con- 
ception of research in education and discusses the 
role research was traditionally expected to play in 
the field. Section 2 focuses on more contemporary 
views about the form and function of research in 
education; evidence of both growing skepticism 
about traditional views and continued acceptance 
of traditional notions is presented. 



This paper was first presented at the American Educational Research 
Association Annual Meetings San Francisco, 1992. Writing of this 
paper was supported by the National Center for Science Teaching 
and Learning under grant # RH7Q0QQ62 from the Office of 
Educational Research and Improvement, U.S. Department of 
Education. Arty opinions, findings, conclusions, or recommendations 
expressed in this publication are those of the author and do not 
necessarily reflect the views of the sponsoring agencies. 



The third section focuses on problems with the 
traditional view of research and the traditional 
view of research's role in applied public policy 
fields such as education. Two problems are dis- 
cussed: the problem of idiosyncracy and the prob- 
lem of immaculate perception. These problems, it 
is argued are sufficiently serious to require more 
than modest, incremental adjustments in tradition- 
al ways of thinking about and traditional ways of 
doing research. 

The final part of the paper focuses on implica- 
tions of the two problems discussed i a Section 3 for 
rethinking the form and function of educational 
research in general and for constructing a research 
agenda for The National Center for Science Teach- 
ing and Learning in particular. 

Traditional Notions 

During the first half of this century progres- 
sive educators had two interrelated items on their 
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reform agenda: (1) taking the schools outpf poli- 
tics and (2) establishing a cadre of professionals who 
they assumed would make educational decisions on 
the basis of research rather than political consid- 
erations. Implicit in the early progressives view of 
both professionalism and educational research was 
a social engineering metaphor which emphasized 
establishing research based standard operating 
procedures for practice and hierarchical control to 
insure these procedures got implemented. (Calla- 
han, 1964;Tyack, 1972). 

Often the social engineering metaphor was even 
made explicit Franklin Bobbitt (1 924), the father 
of the curriculum field, began his classic text. How 
to Make a Curriculum, by likening the work of 
curriculum developers to the work of engineers. 
Similarly, the father of the educational adminis- 
tration field, Ellwood P. Cubberly, wrote in 1909: 

Our schools are, in a sense* factories in which the 
raw products (children) are to be shaped aiH 
fashioned into products to meet the various de- 
mands of life. The specifications for manufactur- 
ing come from the demands for the 
twentieth-century civilization, and it is the busi- 
ness of the school to build its pupils according to 
the specifications laid down. This demands good 
tools, specialized machinery, continuous mea- 
surement of production to see if it is according to 
specifications, the elimination of waste in manu- 
facture, and a large variety in the output (p. 
338). 

Raymond Callahan s (1964) historical account 
of the influence of the efficiency movement on 
school administration and historian David Tyack's 
( 1 974) description of school administrators' search 
for a "one best system* demonstrate that Cubber- 
ly and Bobbins' social engineering orientation was 
shared by the field in general 

Researchers encouraged educators* social 
engineering view of professionalism and suggested 
that research could provide the necessary 
knowledge base to make social engineering possible. 
In 1 9 10, for instance, Thorndike wrote in the lead 
article of the inaugural issue of The Journal of 



Educational Psychology that 

[a] complete science of psychology would tell i /- 
cry fact about everyone's intellect and character 
and behavior, would tell t he cause of every 
change in human nature, would tell the result 
which every educational force— every act of ev- 
ery person that changed any other or the agent 
himself— would have. It would aid us to use hu- 
man beings for the world's welfare with the same 
surety of the result that we now have when we 
use falling bodies or chemical elements. In pro- 
portion as we get such a science we shall become 
masters of our own souls as we are now masters 
of heat and light Progress toward such a science 
is being made (p. 6). 

John Dewey, of course, proposed a somewhat 
different, much less mechanistic version of social 
engineering. As a historian of American education 
recently noted, however, understanding the history 
of American education in the Twentieth Century 
begins with the realization that Dewey lost and 
Thorndike won. 

Mechanistic visions of social engineering imag- 
es did not leave piu^ic consciousness after early 
progressives such as Thorndike, Cubberly and 
Bobbitt were no longer players in the public are- 
na. As late as the 1970's federal policymakers 
funded elaborate planned variation studies which 
policy analysts assured them would tell which pol- 
icies and programs were most effective and conse- 
quently which should be mandated or funded. 
Within education, Project Follow Through (Abt 
Associates, 1977; Haney & Villaume, 1977) is the 
best known example of a planned variation study. 
The goal of this program was to determine the rel- 
ative effectiveness of different early childhood 
education models in educating disadvantaged (the 
adjective of choice of the time) students. 

Other indicators that social engineering imag- 
ery influenced thought and practice well into the 
second half of this century include the use of dis- 
crepancy models of program evaluation which as- 
sessed particular programs by comparing them to 
a model program which research established as 
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successful in another site; the majority of the re- 
search conducted in educational psychology includ- 
ing process-product studies of teaching, virtually 
the only research on teaching conducted prior to 
the 1970's (Good, Biddle, & Brophy, 1975); a host 
of programs and practices such as competency 
based teacher education and competency based 

"The question should not 
be, 'Do they deviate?,... 
but rather, 'Are they 
adapting well to their 
respective 
environments? 11 

teacher evaluation which were legitimated by ei- 
ther explicit or implicit references to process-prod- 
uct studies of teacher effectiveness; and the 
publication, in 1963, of Campbell and Stanley's 
Experimental and Quasi-Experimental Designs for 
Research, a book which codified Thorndike s vision 
of research and served (and continues to serve) as a rule 
book for many who play the research game* 

Contemporary Thinking 

Over the past fifteen or so years one can find 
evidence both of a growing skepticism about the 
traditional vision of educational research and of 
the resilience of traditional views. This section 
documents both trends. 

Increased Skepticism. Over time, members of 
the research community, at least, have became 
increasingly skeptical about researchers* ability to 
deliver the sort of knowledge base which would 
make social engineering possible. The inability of 
the Project Follow Through to provide definitive 
results, for instance, generated skeptMsm in the 
minds of many who previously had espoused the 
virtues of planned variation studies (Rivlin & Tim- 
pane, 1975). One group of scholars, after review- 



ing Project Follow Through data, took note of the 
probabalistic nature of the findings of the study 
and indicated that this aspect of the findings 

should be honored widely and serve as a basis of 
educational policy. Local schools do seem to 
make a difference. The peculiarities of individu- 
al teachers, schools, neighborhoods, and homes 
influence pupils' achievement far more than 
whatever is captured by labels such as basic 
skills or affective education (House, Glass, 
McLean, & Walker, 1978, p. 462). 

Discrepancy evaluation models also have begun 
to be criticized. Spindler, for example, wrote these 
comments about a discrepancy-oriented evaluation 
of programs established by the Youth Employment 
Demonstration Act: u My first reaction was, 'Why 
would anyone expect different programs in differ- 
ent urban sites to replicate a model program in 
another site?* This expectation is against the first 
law of sociocultural systems in that all such systems 
(and a program of any kind is a sociocultural sys- 
tem) are adaptations to their environment. We 
should expect each program to show significant 
deviation from an initiating model, and from each 
of the other programs. The question should not be, 
*Do they deviate? 4 or even 'How do they deviate?*, 
but rather, 'Are they adapting well (functionally) 
to their respective environments?*" (Spindler, as 
cited in Fetterman, 1981, p. 70). 

Furthermore, even Thorndike's field of educa- 
tion psychology has undergone some rather dramat- 
ic changes over the past several decades. By the 
mid 70's for instance, a new line of research on 
teaching— one which focused on the complex pro- 
cess of teacher thinking rather than discrete teach- 
ing behaviors (e.g., Clark & Yinger, 1 977; Shulman 
& Lanier, 1977) had begun to be established. Even 
Gage, a die-hard supporter of process-product mod- 
els of research on teaching, was forced to acknowl- 
edge in 1978 that such research could, at best, only 
provide a general knowledge base for teaching and 
that teacher artistry would always be required to 
adjust and shape that knowledge base to the needs 
of particular students and particular situations. 
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Today process-product studies are difficult to 
find within research on teaching literature. That 
literature is dominated by studies of teacher think- 
ing, a subject which is normally investigated with 
methods more associated with the largely descrip- 
tive discipline of anthropology than with 
Thorndike's social engineering oriented field of 
study. Even single case studies, the sort of studies 
which Campbell and Stanley's rulebook indicated 
had "such a total absence of control as to be of al- 
most no scientific value " (Campbell and Stanley, 
1963, p. 6) have begun to be published by some of 
our most prestigious and selective journals, includ- 
ing The Journal oj Research in Science Teaching, 

Vestiges of the Past. Playing counterpoint to 
the evidence above is evidence which suggests that 
social engineering imagery is alive and well and 
very much present in the thinking of contemporary 
policymakers and even researchers. Evidence of 
the resilience of traditional modes of thinking is 
particularly plentiful in the areas of policymaking 
and program development 

Teacher proof curricula such as DISTAR, for 
instance, are still being used in schools across the 
nation, especially in special education programs 
(Kuder, 1 990). Also states such as Florida, Tennes- 
see, and Texas have used the probabalistic findings 
of teacher effectiveness research to design check- 
list type instruments to assess teachers* competence 
and make certification and merit pay decision. 
Florida did abolish its merit pay system recently 
when some of the state's most dedicated and gift- 
ed teachers failed to score high enough on the 
state's effectiveness instrument to qualify for ex- 
tra compensation, but elsewhere the practice of 
using fool-proof, research based systems to assess 
and reward teacher performance continues. 

At the federal level, the latest buzzword is sys- 
temic reform. Both the National Science Founda- 
tion and the Office of Educational Research and 
;raprovement have endorsed the concept and have 
attempted to reorganize at least some of their pro- 
grams around it It is too early to know precisely 
how this concept will play out in practice (indeed, 
at the moment different federal agencies seem to 



be attaching different meanings to the term), but 
the rhetoric suggests, fairly unequivocally, that 
social engineering imagery undergirds the notion 
of systemic reform. Furthermore, the rhetoric on 
systemic reform seems much closer to the Cubber- 
ly/Thorndike raechanifcic version of social engi- 
neering than it does t j the less mechanistic, less 
control oriented version propounded by Dewey. 

There are, of course, some significant differenc- 
es between earlier mechanistic views of social en- 
gineering and more contemporary systemic reform 
initiatives. The NSF version of systemic reform, 
for instance relies less on social science research as 
a basis for decision making and more on political 
coalition building. Also, most systemic reform 
models, at least, acknowledge the need for some 
discretionary decision making at the local level, 
(See, for example, Smith, 1991.) 

Similar vestiges of earlier ways of thinking can 
be seen within the research community. Within 
the research community, however, vestiges of the 
past seem less a conscious recommitment to the 
notion of social engineering and more a somewhat 
thoughtless adherence to tradition and the stan- 
dard operating procedures of the past This phe- 
nomenon is no more evident than in the field of 
science education. Indeed, a reliance on tradition 
and traditional ways of doing and thinking about 
research is displayed quite clearly on the pages of 
The Journal of Research in Science Teaching, the 
premier research journal of that field within the 
United States. 

Let me quickly acknowledge that The Journal 
of Research in Science Teaching has published 
some truly innovative work in the last few years. 
This work, however, remains on the periphery of 
the field. Evidence of this fact can be found in an 
editorial which appeared in a 1991 issue of the 
journal. In the editorial, the journal's editor, Ron 
Good, reprinted the guidelines which are sent to 
all reviewers of manuscripts which have been sub- 
mitted to the journal. After acknowledging that 
the guidelines "have been used by previous JRST 
editors in nearly the same form, before qualitative 
research in science education became as prevalent 
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Figure 1: /KSrReviewer Guidelines 



SOME GUIDELINES FOR REVIEW 

The following items/questions are intended to assist you in evaluating ind writing a review of the enclosed manuscript This list is 
not necessarily exhaustive nor will each item apply to every type of manuscript You will have to choose those criteria which ap- 
ply to the manuscript enclosed and supplement the list as the need arises. You might wish to use your responses to the appropri- 
ate criteria in composing your review of the manuscript 

l.TfflCQfPutf 

a. Is it descriptive of the study? 

b. Will it facilitate easy retrieval through search system? 

c. Should the title be changed? If yes, what do you suggest? 

d. Does it contain key words or phrases needed in information search systems? 

a. Is it specific enough to communicate the principal parts of the paper? 

b. Is it succinct and accurate? If not which parts should be removed or changed? 

c. Is it missing any critical information? If so, what? 

3. IiitroductioriyRationale 

a. Does it discuss the importance of the study for science teaching? 

b. Does it provide a link between the problem and the study design? 

c. Does it establish a relationship between the study and previous work? 

d. Is the rationale based on pertinent essential work or vague generalizations? 

e. Is the definition of the problem adequate? 

f. Arcthr specific questions reasonable in light of previous research? 

4. Method 

a. Is the method justified? 

b. Is the sample documented and properly selected? 

c. Are the treatments specified in sufficient detail to allow for replication? 

d. Are the models used documented and explained? 

e. Are techniques for data collection appropriate to the enquiry? Have they been adequately specified? 

f. Are data collection instruments valid and reliable? Are they justified? 

g. Is the statistical power of the study discussed? 

h. If Ine study tests hypotheses statistically, are the safeguards against error explained and defended? 

5. Results 

a. Is the data analysis appropriate to the question? 

b. Is the data analysis sufficient? (Are nvans, standard deviations, sums of squares, degrees of freedom, explained variance— re- 
ported where appropriate?) 

c. Are the data tables easy to read and complete? 

d. Are the necessary data reported? If not what is needed? 

e. Are unnecessary data reported? If so, what should be deleted? 

f. Are the illustrations appropriatemecessary? 

g. Has an adequate description been given of the setting of the study and observations made to present a convincing case? 

a. Are the conclusions appropriate to the findings of the study? 

b. Are alternative interpretations recognized and discussed? 

c. Are limitations to the study identified and discussed flow power, multiple sigrufkance, tests, etc.)? 

d. Is the discussion congruent with the introduction/rationale for the study? 

e. Are the implications for science teaching specified and explained? 

f. Did the authors) make an effort to translate theory into practice? 
Reference 

a. Is the reference list adequate for the study? 

b. Are key references missing? If so, which ones? 

c. Are the references outdated, inaccurate? 

d. Are the references cited accurately used? 
8. General Features 

a. Is the paper easy to follow? 

b. Are headings used appropriately? 

c. Should specific sections be shortened/lengthened? 

d. Is the writing style concise? Is the argument clear? 
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as it is today" (p. 291), Good presents a list of the 
present actual guidelines (Figure 1). 

What is interesting here is not just that many 
of these criteria are quite inappropriate to assess- 
ing qualitative work (a problem Good acknowledg- 
es) or that it has taken so long to recognize this and 
begin to do something about it (One of Good's ac- 
knowledged purposes for printing the guidelines 
was to solicit suggestions about how to "make the 
guidelines more sensitive to both qualitative and 
quantitative research issues n lp. 291).). What is 
particularly interesting about the editorial is the 
total absence of even one hint that the utility and 
desirability of the guidelines listed and of the work 
produced by those who follow the guidelines may 
need to be reconsidered and critically examined. 
Rather what we see is a response which smacks of 
incrementalism. A few more people will be let in 
the tent; an alternative entrance might even be pro- 
vided and a new wing might 
even be built. (This is the 
strategy employed by the 
American Educational Re- 
search Association. The 
American Educational i?e- 
search Journal now has two 
distinctly different sections, 
each with its own editor, dis- 
course style, and even refer- 
ence procedures.) Fundamental questions about 
the form and function of the space we inhabit will 
be avoided, however. 

Incrementalism, of course, is highly function- 
al. Schema theorists, for example, note that it is 
normal for individuals to try to assimilate novelty 
into existing ways of thinking and acting and, when 
novelty cannot be assimilated, to try to accommo- 
date novelty without totally upsetting one s concep- 
tual applecart. These tendencies promote 
psychologized stability, virtue, to be sure. 

Furthermore, stability is at least as much of a 
virtue at the organizational/sociological level as it 
is at the level of the individuals and individual 
psychology. There comes a time, however, when 
the problems are too great to be resolved incremen- 



tally. In the next section of this paper I will dis- 
cuss two problems which I believe call out for more 
radical solutions. 



Two Problems 

I have applied labels to the two problems I want 
to discuss* One I call the problem of idiosyncracy; 
the other I have dubbed the problem of immacu- 
late perception* 

The problem of idiosyncracy. Let me try to il- 
luminate the first problem by means of a story. 
The story is about two of ray colleagues at Ohio 
State* Several years ago these two colleagues re- 
ceived a research grant to study young children's 
development. The two professors made a rather 
odd couple. One was an accomplished social scien- 
tist by training and temperament, a person well 

schooled in statistical 
analysis and research 
design. His co-inves- 
tigator was equally 
bright, but she had 
spent most of her ca- 
reer working as a 
teacher. Their dif- 
ferent backgrounds 
created creative ten- 



The response: "Teachers 
do not teach categories 
or types; they teach 
children." 1 



sions and many disagreements. 

One ongoing problem revolved around the 
teacher's complaint that none of the statistical 
descriptions they were generating described any of 
the actual students they had studied. The social 
scientist acknowledged this fact but could not see 
why his co-investigator considered this a problem. 
Social science research, he explained patiently (and 
eventually somewhat impatiently) focused on com- 
monalities and generalities; it described types or 
categories of people not actual people. To this the 
teacher/teacher educator's response was always the 
same: Teachers do not teach categories or types; 
they teach children. 

The teacher's comments get to the heart of the 
problem of idiosyncracy. The problem can be stat- 
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ed as follows: social science is about ideal types; the 
concern of a fie)^ like education, however, is ulti- 
mately individuals not aggregates. 

The research community f s growing realization 
of this problem and its significance can be seen in 
the career of the eminent educational psychologist, 
Lee Cronbach. By the mid 1950s Cronbach had 
already established himself as a skilled player of 
the Thorndike/Carapbell and Stanley research 
game. In 1957, however, Cronbach told the Amer- 
ican Psychological Association that the complexi- 
ty of human phenomena requires a minor 
alteration in the traditional research game plan. 
Rather than searching for laws which were univer- 
sal and context free, Cronbach argued, research- 
ers should attempt to identify cause-effect 
relationships between certain educational treat- 
ments on the one hand and certain types of indi- 
viduals (in Cronbach's terras, individuals with 
certain aptitudes) on the other. 

In the mid 1970s, however, after nearly twen- 
ty years of searching for aptitude x treatment in- 
teractions and nearly twenty years of frustration 
brought on by "inconsistent findings coming from 
roughly similar inquiries, H Cronbach (1975) told 
the American Psychological Association: 

Once we attend to interactions, we enter a hall of 
nirrors that extends to infinity. However far we 
-u'ry our analysis-to third order or fifth order 

or any other-untested interactions of still higher 

order can be envisioned, (p. 119) 

Compounding the problem of complexity was 
the problem of culture. Cronbach cited Bronfen- 
brenner's historical look at child rearing practices 
of middle- and lower-class parents. Class differenc- 
es documented in the 1950s were often just the 
reverse of practices that had been observed in the 
1930s. Cronbach concluded: 

The trouble, as I see it, is that we cannot 
store up generalizations and constructs for 
ultimate assembly into a network. It is as 
if we needed a gross of dry cells to power 
an engine and could only make one a 
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the first cells before we had half the 
battery completed. So it is with the 
potency of our generalizations (p. 123). 

In his 1975 article, Cronbach emphasized that 
the social world was no less lawful than the phys- 
ical world. The problem was that social laws were 
too complex and the social world too changeable to 
identify them. By the early 1 980s, however, Cron- 
bach had rejected even the notion of social laws, He 
began suggesting that the entire cause-effect way 
of thinking which undergirds the traditional view 
of research is an inappropriate way to character- 
ize social phenomena. By 1982, in fact, Cronbach 
had arrived at a position similar to that of symbolic 
interactionists (Blumer, 1969) and ethnomethod- 
ologists (Garf inkle, 1967): Human action is con- 
structed not caused; those who expect research to 
produce the sort of definitive cause-effect gener- 
alizations promised by Thorndike are simply, in 
Cronbach *s words, "Waiting for Godot." 

Not everyone has arrived at as radical a posi- 
tion as Cronbach s, of course, Phillips (1987), for 
iastance, has argued that Cronbach has underes- 
timated the complexity of physical phenomena 
and, hence, overestimated the relative complexi- 
ty of phenomena in the social world. Others might 
point out that researchers are quite capable of gen- 
erating probabalistic findings which can, at least, 
inform us of the likelihood that a particular edu- 
cational treatment will produce a particular edu- 
cational outcome. Few, however, would dispute the 
fact that even if Phillips is correct when he argues 
that the social world is no more complex than the 
physical world (a questionable assumption given 
the fact that Phillips does not even address the 
changeability of culture issue raised by Cronbach), 
educational purposes are almost always more com- 
plex. An engineer employing the theory of quan- 
tum mechanics, for example, is not interested in 
what happens to individual electrons; probabalis- 
tic findings, therefore, will be more than adequate 
to accomplish the engineer's purpose. Teachers, 
however, do care about individual students; prob- 
abalistic findings, therefore, have limited utility 
in accomplishing complex educational purposes. A 
probabalistic finding, after all, not only tells us 
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what is likely to occur; it also reminds us that what 
is unlikely may very well happen. 

In short, no nutter how large our sample, we 
can never know whether research findings will 
apply to a new and different case or even to a par- 
ticular case in the original sample. This fact cer- 
tainly does not require tliat we totally reject the 
traditional research game. It does require, howev- 
er, that we reject Thorndike's notion that social 
science research can provide the sort of knowledge 
base which could support social engineering. 

The Problem of Immaculate Perception. The 
problem of immaculate perception has been recog- 
nized in an array of disciplines and fields of study, 
although each discipline and field tends to charac- 
terize the problem in a somewhat different way. 
Philosophers of science talk in terms of paradigms 
or conceptual frameworks. Psychologists use the 
terms schema or cognitive structures. Anthropolo- 
gists talk of cultural constructs; literary critics of 
interpretive frameworks. I am not suggesting that 
each of these terms is 1 precise synonym for the 
other; each, however, alludes to the fact that we do 
not have direct access to reality and that our per- 
ceptions of the empirical world will always be in- 
fluenced by (often unconscious) a priori conceptions 
of what reality is and ought to be. 

The significance of this problem for a field like 
education can be demonstrated by considering a 
term such as learning* Few people would disagree 
with the proposition that schools should promote 
learning, but the term learning will mean quite 
different things to different people, to Piagetian 
and Skinnerian psychologists, for instance. Before 
a researcher can determine whether Program A 
produces more learning than Program B, the re- 
searcher must choose one of the paradigms— i.e., 
one of tie meanings— alluded to above or one of the 
multitude of other meanings which could be asso- 
ciated with the term learning* The meaning select- 
ed will influence the researchers findings at least 
as much as the empirical reality being described. 

The situation is further complicated by the fact 
that, from certain paradigmatic perspectives, the 



whole cause-effect way of thinking and talking 
employed by traditional researchers becomes prob- 
lematic. Freire (1970), Buber (1968), peace edu- 
cators like Galtung(1974), and a humanist reading 
of Dewey (see Kleibard 1975), for example, suggest 
that educational practice should not be built 
around predetermined student learning outcomes, 
no matter what conception of learning the prede- 
termined outcomes reflect. This position suggests 
that rather than attempting to control students, 
tea<iters should engage in dialogue with students, 
and rather than transmitting a predefined curric- 
ulum to students, teachers should work with stu- 
dents to construct jointly the curriculum for the 
class. 

These prescriptive educational theories are 
compatible with the theoretical descriptions of 
human action put forth by symbolic interactionists, 
ethnomethodologists, and the 1980 f s version of 
Cronbach. Whether one agrees with these descrip- 
tive theories or not, they do provide an alternative 
to Campbell and Stanley's conception of how the 
social world operates. As such, they remind us that 
Campbell and Stanley's cause and effect conception 
of the social world is just that, an a priori concep- 
tion, a conception which is not determined by the 
facts but rather determines what the facts are. In 
short, they reinforce a point made by Kant years 
ago: It is impossible to talk of the nature of reali- 
ty with any sense of certainty because we can never 
know reality independent of the cognitive struc- 
tures which influence our perceptions. 

Implications 

In this final section of the paper I want to brief- 
ly consider some implications of the two problems 
outlined above. General implications for rethink- 
ing the form and function of science will be dis- 
cussed. I will also provide more specific examples 
of how the problems outlined above have influ- 
enced the development of the National Center for 
Science Teaching and Learning's research agenda. 

Implications of the Idiosyncracy Problem. One 
obvious implication of the problem of idiosyncra- 
cy is the realization that research will never be able 
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to provide prescriptions for practice; at best it will 
serve only a heuristic function. Of course, this does 
not mean that research is useless. Weiss ( 1 982), for 
example, suggests one heuristic function for social 
science research in her study of policy makers* uti- 
lization of research in formulating health policy. 
She indicates that research was of little use in prob- 
lem solving but very important in problem fram- 
ing. Social science research helped structure 
policy makers' thinking by supplying language 
with which to conceptualize policy questions. In 
the process, research directed policy makers atten- 
tion tc possibilities and options which probably 
would not have been considered in the absence of 
research. Social science research can certainly 
serve a similar role in the decision making of teach- 
ers and other educational professionals. 

Social science research can also tell us what is 
typical and give us some sense of what will typi- 
cally occur if we employ different types of educa- 
tional strategies. This sort of information will be 
especially useful to educational policymakers. 
Unlike teachers who must be concerned with edu- 
cating idiosyncratic individuals, policy makers are 
primarily concerned with aggregates. Like social 
scientist, it is functional for policymakers to think 
in terras of types of people. 

Policymakers, of course, must realize that if 
educators are to meet the needs of students they 
must design policies and programs which allow for 
considerable discretion at the school and classroom 
levels. After all, a probabalistic generalization 
which tells us what will typically occur also informs 
us that the atypical will occur witb some individ- 
uals in some settings. Therefore even relatively 
definitive research findings do not automatically 
translate into policies and programs. Once again, 
they serve only as a heuristic, not as a recipe. 

The heuristic nature of research certainly sug- 
gests the need to reconsider standard operating 
ways of thinking about research arid standard op- 
erating ways of doing it. For instance, given Weiss' 
conclusion that research helps us to frame rather 
than to solve problems, it might make sense to 
think of the whole matter of generalization in psy- 



chological rather than in statistical and sampling 
terms. If we do this, single case studies suddenly 
appear to have far more utility than was tradition- 
ally thought. (For an in-depth exploration of this 
idea, see Donraoyer, 1990.) 

At the very least, an understanding of the prob- 
lem of idiosyncracy forces us to lower our expec- 
tations for large scale research projects. At best 
such projects will net findings which will have to 
be shaped and adjusted by actors at tlie local level 
to fit local contextual variables. This recognition 
of the heuristic function of research and the im- 
portance of the local may lead to a blurring of the 
traditional distinction between research and devel- 
opment efforts, such as the work carried out by 
Berlir and White at the NCSTL (1992). 

Implications of the Immaculate Perception 
Problem. Just as the idiosyncracy problem calls 
into question traditional ideas about 
generalization, the problem of immaculate 
perception challenges traditional notions of 
objectivity. Furthermore, the recognition that the 
frames people bring to a problem to a large extent 
dictate the solutions they find also has influenced 
the Center's decision to bring together diverse 
constituencies (e.g. science teachers, teacher 
educators, administrators, practicing scientists 
from multiple disciplines, business persons, and 
policymakers) which employ very different frames 
of reference to discuss and analyze the problems 
of science education. The purpose in doing this is 
a bit different from the purpose which appears to 
undergird NSF's coalition building activities in the 
systematic reform initiatives it has attempted to 
promote. We see such gatherings as a form of 
inquiry, a form of inquiry which hearkens back to 
Aristotelian notions of deliberation and practical 
reasoning. (For further discussion of these ideas, see 
Donmoyer, 1991a, 1991b, 1990.) 

One additional implication of the problem of 
immaculate perception involves the need to expand 
the substantive focus of our research. We need to 
focus on how teachers and others conceptualize 
science and how different cultural perceptions can 
affect the learning of science as it is conceptualized 
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within the culture of schools. To adequately inves* 
tigate cultural phenomena, we may also need to 
employ methods from fields such as anthropology. 
Such methods are now widely accepted within the 
educational research community in general but are 
less commonplace form in the subfield of science 
education. 

Summary 

In this paper I reviewed traditional notions 
about the form and function of educational re* 
search* examined contemporary manifestations of 
these notions, and discussed two problems with 
traditional ways of conceptualizing what research 
is and what role research should play. I also briefly 
discussed some implications of these two problems 
for reconceptualizing the form and function of 
educational research in general and formulating a 
research agenda for the National Center of Science 
Teaching and Learning in particular. 
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